Discretization problems on generalized entropies and R-divergences
نویسندگان
چکیده
In many practical applications, data about an unknown continuous distribution arise in a grouped form. For these cases, estimation of population entropies and divergences must be done by means of their sample discretized estimates. In this paper, the problem of loss of information due to the discretization of the data is studied for (h, )-entropies and R^-diveigences. Quadratic convergence theorems are given and asymptotic distributions are obtained.
منابع مشابه
Escort entropies and divergences and related canonical distribution
We discuss two families of two-parameter entropies and divergences, derived from the standard Rényi and Tsallis entropies and divergences. These divergences and entropies are found as divergences or entropies of escort distributions. Exploiting the nonnegativity of the divergences, we derive the expression of the canonical distribution associated to the new entropies and a observable given as a...
متن کاملGeneralized Entropies and the Similarity of Texts
We show how generalized Gibbs-Shannon entropies can provide new insights on the statistical properties of texts. The universal distribution of word frequencies (Zipf’s law) implies that the generalized entropies, computed at the word level, are dominated by words in a specific range of frequencies. Here we show that this is the case not only for the generalized entropies but also for the genera...
متن کاملLattice Discretization in Quantum Scattering
The utility of lattice discretization technique is demonstrated for solving nonrelativistic quantum scattering problems and specially for the treatment of ultraviolet divergences in these problems with some potentials singular at the origin in two and three space dimensions. This shows that lattice discretization technique could be a useful tool for the numerical soiution of scattering problems...
متن کاملdeBruijn identities: from Shannon, Kullback–Leibler and Fisher to generalized φ -entropies, φ -divergences and φ -Fisher informations
In this paper we propose a generalization of the usual deBruijn identity that links the Shannon differential entropy (or the Kullback–Leibler divergence) and the Fisher information (or the Fisher divergence) of the output of a Gaussian channel. The generalization makes use of φ -entropies on the one hand, and of φ -divergences (of the Csizàr class) on the other hand, as generalizations of the S...
متن کاملGeneralization of the de Bruijn's identity to general $\phi$-entropies and $\phi$-Fisher informations
In this paper, we propose generalizations of the de Bruijn’s identities based on extensions of the Shannon entropy, Fisher information and their associated divergences or relative measures. The foundation of these generalizations are the φ-entropies and divergences of the Csiszár’s class (or Salicrú’s class) considered within a multidimensional context, included the monodimensional case, and fo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Kybernetika
دوره 30 شماره
صفحات -
تاریخ انتشار 1994